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Amendments to the Claims: 

This listing of claims will replace all prior versions, and 
listings, of claims in the application: 

Listing of Claims: 

1. (Previously Amended) A learning item sequencing system 
for optimizing a student's learning speed, the system 
comprising: 

a computer including one or more memory portions; 

the memory portions comprising: 

a problem database containing a plurality of learning 
items, wherein a learning item is presented on each learning 
trial; 

a trial record database, for storing response data 
regarding the student's response to each learning item , wherein 
the response data includes data relating to speed and accuracy ; 

software for implementing a trial loop, wherein the 
learning trials are presented to the student and response data 
are collected; and 

software for implementing a sequencing algorithm, 
wherein the algorithm sequences the learning items to be 
presented by associating with a learning item a priority score 
as a function of the response data collected from prior learning 
trials and restricts one or more learning items from being 
presented in at least one learning trial based upon the priority 
score associated with the learning item. 
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2. (Original) The sequencing system of claim 1, wherein 
the response data collected for each learning trial includes the 
student's accuracy in answering the presented learning item and 
the student's response speed if the item was correctly answered. 

3. (Original) The sequencing system of claim 2, wherein 
each learning trial includes a priority score associated with 
the particular learning item. 

4. (Original) The sequencing system of claim 3, wherein 
the sequencing algorithm continuously updates the priority score 
of each learning item based on the response data collected on 
the immediately preceding learning trial. 

5. (Original) The sequencing system of claim 4, wherein 
the number of trials since a particular learning item was last 
presented is a variable used by the sequencing algorithm in 
continuously updating the priority score of each learning item. 

6. (Previously Amended) The sequencing system of claim 4, 
wherein [^fee] relative importance of the student's speed and 
accuracy in sequencing of learning items is a parameter. 

7. (Original) The sequencing system of claim 5 f wherein 
the software for implementing a trial loop includes a problem 
selector, the problem selector selecting the learning item with 
the highest priority score for presentation to the student. 
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8. (Original) The sequencing system of claim 6, wherein 
when a subset of the plurality of learning items have the same 
high priority score, the problem selector selects the learning 
item for presentation at random from the subset of learning 
items with the same high priority score. 

9. (Previously Amended) The sequencing system of claim 6, 
wherein the sequencing algorithm increases the priority score 
for each incorrectly answered learning item, wherein the 
probability of each incorrectly answered learning item being 
again selected by the problem selector increases, whereby [^e] 
delay in learning item reappearance decreases, 

10. (Previously Amended) The sequencing system of claim 6, 
wherein the sequencing algorithm decreases the priority score 
for each correctly answered learning item, wherein the 
probability of that learning item being again selected by the 
problem selector decreases, whereby [fcfee] delay in learning item 
reoccurrence increases „ 

11. (Previously Amended) The sequencing system of claim 
10, wherein the sequencing algorithm decreases the priority 
score for each correctly answered learning item as a function of 
the student's response time in answering the question, wherein 

delay in a particular learning item/ s reappearance 
increases as the student's response time to the particular 
learning item decreases. 



PAGE 5127 1 RCVD AT 2/5/2004 3:24:26 PM [Eastern Standard Time] * SVR:USPTO-EFXRF«212 1 DNIS:7463234 * CSID:1 628 577 8800 1 DURATION (mifrSS):05-52 



-4- 



02/05/2004 12:22 FAX 1 626 



CPH 




12)006 



Appln No. 10/020,718 

Amdt date February 4, 2004 

Reply to Office action of December 31, 2003 

12. (Original) The sequencing system of claim 5, wherein 
the sequencing algorithm prevents the same learning item from 
recurring for a predetermined number of trials. 

13. (Original) The sequencing system of claim 6, wherein 
each learning item may be assigned an initial priority score. 

14. (Original) The sequencing system of claim 13, wherein 
the sequencing algorithm does not modify the priority score of 
each item until after its first presentation. 

15. (Original) The sequencing system of claim 14, wherein 
the initial order of appearance of all, or some, of the learning 
items may determined in advance by assigning all, or some, of 
the learning items initial priority scores in ascending or 
descending order. 

16. (Original) The sequencing system of claim 11, wherein 
the software for implementing the trial loop includes a learning 
item retirement feature, wherein the learning items are retired 
from the problem database upon meeting a predetermined learning 
criterion. 

17. {Previously Amended) The sequencing system of claim 
16, wherein [£he] a learning criterion for each particular 
learning item is a function of the student's accuracy in 
answering the learning item, and response speed for each correct 
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answer, over a predetermined number of repetitions of the 
learning item. 

18. (Original) The sequencing system of claim 17, wherein 
a session resumption feature stores an individual learner's data 
for learning items, in terms of speed, accuracy, and problem 
retirement status for continuing the learning during another 
session at a later tint©. 

19. (Original) The sequencing system of claim 17, wherein 
the session resumption feature allows learning to continue at 
another time whence the retirement count of retired learning 
items is reduced, bringing them back for review and "re- 
retiring" if performance still meets learning criteria. 

20. (Original) The sequencing system of claim 17, wherein 
the session resumption feature allows previously retired 
learning items brought back for review to rejoin the active 
problem set if performance criteria do not meet the previously 
established learning criteria. 

21. (Original) A learning item sequencing system for 
optimizing a student's learning, comprising: 

a computer including a central processing unit, a visual 
display device, at least one input device, and one or more 
memory portions ; 

the memory portions comprising: 
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a problem database, wherein a plurality of learning 
items for presentation to the student is stored in the database, 
and further wherein each learning item has an associated 
priority score ; 

a trial record database, for storing a record 
containing response data regarding the student's response to 
each learning item, the response data collected for each 
learning item including the student's accuracy in answering each 
learning item and the student's response speed for each 
correctly answered learning item, the response data further 
including the number of trials since each particular learning 
item was last presented; 

software for implementing a trial loop, wherein the 
learning trials are presented to the student and the response 
data are collected, the software including a problem selector, 
wherein the problem selector selects the learning item with the 
highest priority score for presentation to the student; and 

software for implementing a sequencing algorithm, 
wherein the algorithm continuously updates the priority scores 
for each learning item as a function of the response data 
collected from the prior learning trials, the sequencing 
algorithm increasing the priority score for each incorrectly 
answered learning item and decreasing the priority score for 
each correctly answered learning item, wherein the probability 
of a particular learning item being again selected by the 
problem selector increases or decreases as a function of 
priority score - 
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22. (Original) The sequencing system of claim 21, wherein 
the sequencing algorithm continuously updates the priority score 
of each learning item based on the response data collected for 
the immediately proceeding learning trial. 

23. (Original) The sequencing system of claim 21, wherein 
when a subset of the plurality of learning items have the same 
high priority score, the problem selector selects the learning 
item for presentation at random from the subset of learning 
items with the same high priority score. 

24. (Original) The sequencing system of claim 21, wherein 
the sequencing algorithm decreases the priority score for each 
correctly answered learning item as a function of the student's 
response time in answering the question, wherein the faster the 
student's response time the greater the decrease in priority 
score. 

25. (Original) The sequencing system of claim 21, wherein 
the sequencing algorithm prevents the same learning item from 
recurring for a predetermined number of trials. 

26. (Original) The sequencing system of claim 21, wherein 
the priority score associated with each learning item may be 
assigned an initial value. 

27. (Previously Amended) The sequencing system of claim 
26, wherein the sequencing algorithm does not modify the 
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priority score of each learning item until after the first 
presentation of each particular learning item. 

28. (Original) The sequencing system of claim 26, wherein 
the initial order of appearance of all, or some, of the learning 
items may determined in advance by assigning all, or some, of 
the learning items initial priority scores in ascending or 
descending order. 

29. (Original) The sequencing system of claim 21, wherein 
the software for implementing the trial loop includes a learning 
item retirement feature, wherein the learning items are retired 
from the problem database upon meeting a predetermined learning 
criterion. 

30. (Original) The sequencing system of claim 21, wherein 
the learning criterion for each particular learning item is a 
function of the student's accuracy in answering that learning 
item, and response speed for each correct answer, over a 
predetermined number of repetitions of the learning item. 

31. (Previously Amended) A method for learning item 
sequencing for optimizing a student's learning speed, the method 
comprising: 

supplying a computer including one or more memory portions; 
the memory portions having software which performs the 
steps of: 
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building and maintaining a problem database containing 
a plurality of learning items; 

building and maintaining a trial record database, for 
storing response data regarding the student's response to each 
learning ite m, wherein the response data includes data relating 
to speed and accuracy ; 

implementing a trial loop, wherein the learning items 
are presented to the student and response data are collected; 
and 

implementing a sequencing algorithm, wherein the 
algorithm sequences the learning items to be presented as a 
function of the response data collected from prior learning 
trials by associating priority scores with learning items and 
restricting certain learning items from being presented in at 
least one learning trial . 

32. (Previously withdrawn) A perceptual learning system 
for teaching students to recognize diagnostic structure from 
varying instances, the system comprising: 

a problem database containing a plurality of learning items 
which are examples of different concepts, which, with respect to 
any one concept, includes a number of positive instances 
containing diagnostic structural elements and a number of 
negative instances which do not contain the diagnostic 
structural elements of the concept; and 

software for implementing a trial loop, wherein the 
learning items are presented to the student in the form of short 
speeded classification trials. 
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33. (Previously withdrawn) The perceptual learning system 
of claim 32 , wherein the problem database includes learning 
trials in the form of structure discovery trials and structure 
mapping trials, the structure discovery trials requiring the 
student to recognize the diagnostic structure that determines a 
concept in a particular learning domain, distinguish positive 
and negative instances of the concept, and process the 
distinguishing information rapidly, and the structure mapping 
trials requiring the student to associate a structure in one 
representational format with the structure as it appears in one 
or more different representational formats. 

34. (Previously withdrawn) The perceptual learning system 
of claim 33, wherein the problem database contains numerous 
instances exemplifying a given concept to be learned, and the 
set of instances systematically varies in attributes and 
dimensions other than the diagnostic structure determining the 
concept. 

35. (Previously withdrawn) The perceptual learning system 
of claim 33, wherein for each concept to be learned, the problem 
database contains numerous instances not belonging to that 
concept, for use as negative instances in classification trials. 

36. (Previously withdrawn) The perceptual learning system 
of claim 33, wherein for each concept to be learned, the 
negative instances systematically vary in their attributes and 
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dimensions and share with positive instances of the concept 
various attributes and dimensions other than the diagnostic 
structure features determining inclusion of the concept. 

37. (Previously withdrawn) The perceptual learning system 
of claim 32, wherein the learning trials include a pattern 
classification response or a pattern comparison response. 

38. (Previously withdrawn) The perceptual learning system 
of claim 32, wherein the student is given feedback regarding his 
performance after each learning trial. 

39. (Previously withdrawn) The perceptual learning system 
of claim 32, further including a trial record database, for 
storing response data regarding the student's response to each 
learning item and the concept of which it is an instance, the 
response data including the accuracy of the student's answer to 
each learning item, and the speed of the student 7 s response to 
each correctly answered learning item, 

40. (Previously withdrawn) The perceptual learning system 
of claim 39, wherein the software for implementing the trial 
loop includes a retirement feature for concepts, wherein the 
individual concepts are retired from the problem database upon 
meeting a predetermined learning criterion for instances of that 
concept, wherein the learning criterion is a function of the 
student's accuracy in answering novel instances of that concept, 
and response speed for each correct answer, over a predetermined 
number of presentations of instances of that concept. 

-12- 
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41. (Previously withdrawn) The perceptual learning system 
of claim 32, wherein the software for implementing a trial loop 
includes a problem selector, the problem selector selecting each 
learning item at random from the problem database. 

42. (Previously withdrawn) The perceptual learning system 
of claim 41, wherein the problem selector, selects each learning 
item from the problem database according to the system of claim 
21- 

43. (Previously withdrawn) h perceptual learning system 
for teaching students to recognize diagnostic structure from 
varying instances, the system comprising: 

a computer including a central processing unit, a visual 
display device, at least one input device, and one or more 
memory portions; 

the memory portions comprising; 

a problem database containing a plurality of learning 
items, wherein each learning item is in the form of a structure 
discovery trial or a structure mapping trial, the structure 
discovery trials requiring the student to recognize the 
diagnostic structure that determines a concept in a particular 
learning domain, distinguish positive and negative instances of 
the concept, and process the distinguishing information rapidly, 
and the structure mapping trials requiring the student to 
associate a structure in one representational format with the 
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structure as it appears in one or more different 
representational formats ; 

software for implementing a trial loop, wherein the 
learning trials are presented to the student in the form of 
short speeded classification trials, wherein the classification 
trials include a pattern classification response or a pattern 
comparison response. 

44. (Previously withdrawn) The perceptual learning system 
of claim 43, wherein the student is given feedback regarding his 
performance after each learning trial, 

45. (Previously withdrawn) The perceptual learning system 
of claim 43, further including a trial record database/ for 
storing response data regarding the student's response to each 
learning trial, the response data including the accuracy of the 
student's answer to each learning trial, and the speed of the 
student's response to each correctly answered learning trial. 

46. (Previously withdrawn) The perceptual learning system 
of claim 43, wherein the software for implementing the trial 
loop includes a concept retirement feature, wherein concepts are 
retired from the problem database upon meeting a predetermined 
learning criterion, wherein the learning criterion is a function 
of the student's accuracy in answering the instances of that 
concept, and response speed for each correct answer, over a 
predetermined number of repetitions of each concept. 
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47. (Previously withdrawn) The sequencing system of claim 
46, wherein the contributions to concept retirement of learner 
speed, accuracy, and number of presentations meeting speed and 
accuracy criteria, are parameter adjustable- 

48. (Previously withdrawn) The perceptual learning system 
of claim 43, wherein the software for implementing a trial loop 
includes a problem selector, the problem selector selecting a 
learning item for each learning trial at random from the problem 
database - 

49. (Previously withdrawn) The perceptual learning system 
of claim 43, wherein the problem selector, selects a learning 
item for each learning trial from the problem database according 
to the system of claim 17. 

50. (Previously withdrawn) A perceptual learning method 
for teaching students to recognize diagnostic structure from 
varying instances, comprising the steps of: 

supplying a computer including one or more memory portions; 
the memory portions having software which performs the steps of: 
building and maintaining a problem database containing a 
plurality of learning items which are examples of different 
concepts, which, with respect to any one concept, includes a 
number of positive instances containing diagnostic structural 
elements and a number of negative instances which do not contain 
the diagnostic structural elements of the concept; and 
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implementing a trial loop, wherein the learning trials are 
presented to the student in the form of short speeded 
classification trials. 

51- (Previously withdrawn) An automated, time^based 
hinting method for promoting learning and preventing student 
frustration, the method comprising the steps of: 

running a learning program; 

building and maintaining a database of hints 
presenting a student with a learning trial; 

selecting a hint if the student fails to respond in a 
predetermined period of time or fails to answer the learning 
item for that trial correctly; and 

presenting the hint to the student. 

52. {Previously withdrawn) The hinting method of claim 51, 
further including the step of providing feedback to the student 
after the student has responded to the hint. 

53. (Previously withdrawn) The hinting method of claim 51, 
wherein the software selects hints from the group consisting of 
inverse operation hints, known problem hints, easy problem 
hints, and solved problem hints. 

54. (Previously withdrawn) The hinting method of claim 51, 
wherein the software includes a hint selector that selects hints 
at random from the database of hints. 
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55. (Previously withdrawn) The hinting method of claim 51 , 
wherein the software includes a hint selector that selects hints 
according to an algorithm. 

56. (Previously withdrawn) The hinting method of claim 53, 
wherein the software includes a hint selector that keeps track 
of previously used hints and hint categories to ensure that 
different hint types and instances are used about equally often. 

57. (Previously withdrawn) An automated, time-based system 
for providing hints in order promote learning and prevent 
student frustration, the system comprising: 

a computer including a central processing unit, a visual 
display device, at least one input device, and one or more 
memory portions; 

the memory portions comprising: 



software for implementing a hinting procedure, wherein a student 
is presented with a learning trial and a hint is selected and 
presented to the student if the student fails to respond in a 
predetermined period of time or fails to answer the learning 
item for that trial correctly. 

58. (Previously withdrawn) The hinting system of claim 57, 
wherein the hint procedure provides feedback to the student 
after the student has responded to the hint. 



software for running a learning program; 

a hint database containing a plurality of hints; and 
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59. (Previously withdrawn) The hinting system of claim 57, 
wherein hints are selected from the group consisting of inverse 
operation hints, known problem hints, easy problem hints, and 
solved problem hints. 

60. (Previously withdrawn) The hinting system of claim 57, 
wherein the software includes a hint selector that selects hints 
at random from the database of hints. 

61. (Previously withdrawn) The hinting system of claim 57, 
wherein the hint procedure includes a hint selector that selects 
hints at random from the database of hints. 

62. (Previously withdrawn) The hinting system of claim 57, 
wherein the hint procedure includes a hint selector that keeps 
track of previously used hints to ensure that different hint 
types are used about equally often. 

63. (Previously added) The learning system of claim 1, 
wherein the sequencing algorithm sequences categories of 
learning items. 

64. (Previously added) The learning system of claim 1, 
wherein the learning items comprise categories of learning 
items . 

65. (Previously added) The learning system of claim 1, 
wherein the sequencing algorithm further includes one or more 
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parameters selected from the group consisting of relative 
importance of speed and accuracy, minimum trials separating 
learning item recurrence, and retirement criteria, wherein one 
or more parameters may be adjusted to suit different learning 
material, tasks or individuals. 

66. (Previously added) The learning system of claim 21, 
wherein the sequencing algorithm sequences categories of 
learning items. 

67. (Previously added) The learning system of claim 21 , 
wherein the learning items comprise categories of learning 
items . 

68. (Previously added) The learning system of claim 21, 
wherein the sequencing algorithm further includes one or more 
parameters selected from the group consisting of relative 
importance of speed and accuracy, minimum trials separating 
learning item recurrence, and retirement criteria, wherein one 
or more parameters may be adjusted to suit different learning 
material, tasks or individuals. 

69. (Currently amended) The learning system of claim [21] 
31, wherein the sequencing algorithm sequences categories of 
learning items. 

70. (Currently amended) The learning system of claim [21] 
31, wherein the learning items comprise categories of items. 
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71. (Previously added) The learning item sequencing method 
of claim 31, wherein the step of building and maintaining a 
problem database containing a plurality of learning items 
comprises building a plurality of learning items representing 
categories of items. 

72. (Previously added) The learning sequencing method of 
claim 31/ wherein the sequencing algorithm further includes one 
or more parameters selected from the group consisting of 
relative importance of speed and accuracy, minimum trials 
separating learning item recurrence, and retirement criteria, 
wherein one or more parameters are adjusted to suit different 
learning material, tasks or individuals. 
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